Multiscale Fractal Descriptors Applied to Texture Classification 
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This work proposes the combination of multiscale transform with fractal descriptors employed in the clas- 
sification of gray-level texture images. We apply the space-scale transform (derivative + Gaussian filter) 
over the Bouligand-Minkowski fractal descriptors, followed by a threshold over the filter response, aiming at 
attenuating noise effects caused by the final part of this response. The method is tested in the classification 
of a well-known data set (Brodatz) and compared with other classical texture descriptor techniques. The 
results demonstrate the advantage of the proposed approach, achieving a higher success rate with a reduced 
amount of descriptors. 
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I. INTRODUCTION 

Texture analysis is one of the most studied problems 
in Computer Vision aredr^. The methodology employed 
in such problems may be divided into 4 categories^, to 
know, structural, statistical, spectral and model-based 
methods. In this last category, we find the fractal tech- 
niques. 

Fractal geometry shows to be an efficient tool to char- 
acterize and discriminate complex objects usually found 
in texture images^ ^. This precision of fractal represen- 
tation is explained by the ffexibility of a fractal object, 
given its nature instrinsically complex. Moreover, frac- 
tals are strongly identified by their self-similarity behav- 
ior, that is, each part constitutes a copy only linearly 
transformed of the whole structure. Such characteristic 
is also widely observed in many objects from the real 
world, in a greater or smaller degree of intensity. 

Among the most known fractal-based techniques, 
we can cite the mult ifr act als^, the multiscale fractal 
dimensiorP and the fractal descriptors. Here, we choose 
fractal descriptors approach, due to their high effi- 
ciency demonstrates in several works studying texture 
analysi#^ 

Despite its efficiency, fractal descriptors still have prob- 
lems with the analysis of images presenting a significant 
amount of patterns and details, which may be observed 
only at some specific scales. This is explained by the 
fact that, although fractal descriptors analyzes the im- 
age under different scales, the descriptors themselves are 
represented globally and are not able to highlight any 
kind of individual scale. 

With the aim of overcoming such drawback, this work 
develops and studies a novel approach where a multiscale 
transform^ ^ is applied to the original descriptors. Partic- 
ularly, we employed a space-scale transform (derivative 
+ Gaussian filter) and applyed a threshold over the filter 
response in order to discard some irrelevant information. 
The application of a multiscale transform enabled the use 



of fractal descriptors as not only a global curve which 
describes the image, but a set of informations about de- 
tails, patterns and irregularities observed at a wide range 
of scales. 



II. FRACTAL GEOMETRY 

Fractal geometry is the area which studies fractal ob- 
jects. Fractals are complex geometrical structures char- 
acterized by an infinite degree of self-similarity, that is, 
each part of the object corresponds to a copy of the 
whole, only affec ted b y linear geometrical transforms 
(affine transforms)P^^^. 

As well as fractals, we may find a large number of 
structures in nature also characterized by a high level 
of repetition of patterns. Moreover, we also verify that 
many of such natural object cannot find a precise enough 
representation through Euclidean classical geometry^^ESl^ 
Such observations yield researchers to aplpy fractal geom- 
etry tools in a wide range of problems in several areas^^. 
Among the employed fractal tools, fractal dimension is 
the most used. 



A. Fractal Dimension 

As well as in Euclidean geometry we have metrics like 
perimeter and area, fractal dimension is a fundamental 
characteristic measure of a fractal object. 

Essentially, this metric is obtained by measuring the 
extension of the object through a rule with a variable 
side-length. The dimension of an object S is given by 
the following expression: 
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(1) 



where N is the number of units with length e necessary 
to cover the whole object. 



The above equation is only usable when we know the 
exact mathematical rule which gave rise to the fractal 
object. In practical situations like in this work, when 
we are dealing with objects represented in a digital im- 
age, we must turn to estimation methods which provide 
an approximate fractal dimension value. Most of such 
methods are based on a generalization of the Equation 
[l] where, instead of the number of rules N, we use any 
complexity metric whether in spatial or frequency space. 

Among such estimation methods, we opted to use the 
Bouligand-Minkowski (BM) technique. This choice was 
based on its good performance in texture analysis prob- 
lems similar to those showed in this work^ ^^ i4 i6 

The Bouligand-Minkowski approach consists in some 
basic steps. Initially, the gray-level intensity texture im- 
age / G [1 : M] X [1 : A/"] ^ 5R is mapped onto a three- 
dimensional surface S in the following manner: 



S = {i,j,f{i,j)\{i,j) G [1 : M] X [1 : N]}, (2) 



and 



fihj) = {1,2, ...,max/}|/ = I{iJ), 



(3) 



being maxi the maximum intensity value of the image. 
In the following, the surface is dilated by a sphere with 
a variable radius r, that is, around each point with coor- 
dinates (x, ?/, z) of the surface, we construct a sphere with 
radius r and center at (x^y^z). For each value of r we 
can compute the dilation volume V(r) in a st right forward 
manner by: 



V{r) = {[JB,{p)}, 

pes 



(4) 



where Br are the spheres. An equivalent expression is 
the following: 



V{r) = {pi G i?3|3p2 e S:\pi -pal < r}, 



(5) 



where pi is a point outside the surface, while p2 is inside 
S. 

Finally, varying the values of r along a specifical in- 
terval obtained empirically, the dimension is estimated 
through the following expression: 
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The Figure [T] illustrates the dilation process. 



(6) 



III. FRACTAL DESCRIPTORS 

Despite its importance as a characterizer of objects, 
fractal dimension is still limitted, mainly when we need 
to discriminate among a large number of objects with a 
high degree of similarity. Such difficulty can be justified 
by two main aspects. The first is that fractal dimension 
is only a unique value to describe the whole complexity 




(d) 



FIG. 1. Dilation of the surface to obtain the Bouligand- 
Minkowski dimension, (a) Texture image, (b) Surface rep- 
resentation, (c) An example of dilation of the surface (in this 
case, with r = 10). d) Curve log(V) x log(r). 



of an object. The second is that we observe a lot of 
objects with a completely distinct appearance whilst they 
have the same estimated fractal dimension^^. In order to 
overcome such drawback, Bruno et al.^^ developed a novel 
methodology called fractal descriptors. 

This technique consists in composing a set of features 
(descriptors) from the power-law fractality curve of the 
analyzed object. In Bouligand-Minkowski method used 
here, such descriptors are obtained from the dilation vol- 
ume values. We explain the procedure to compute such 
values in the following. 

Based on the Equation [5] and on the fact that we are 
dealing with a discrete space, the Euclidean Distance 
Transform (EDT)P^ shows to be a powerful method to 
compute BM dimension. In this way, we construct a dis- 
tance mapping for the surface 5, using pre-defined values 
for the distance: 



E = 0,l,V2,...,l,..., 



(7) 



where 



leD = {d\d={f+jy/^;i,jeN}. (8) 



Thus, we define the set gr{S) of points at a distance r 
from a point with coordinates {Sx^ Sy^ Sz) in S: 

gr{S) = {{x,y,zmx - S^f + {y - Syf + {z - S,f]'/^ = E{r)} , 

(9) 
Finally, the dilation volume is given by: 



V{r) = J2Qii), 



(10) 



i=l 



where Q{i) represents the number of points at a distance 
i < r: 



ix,y,z) 



(11) 



where x is the indicator function: Xa{x) = 1 if x G A 
and Xa{x) = otherwise. 

The descriptors are obtained from the power-law rela- 
tion u between V{r) and r, that is: 



u : log(r) -^ log{V{r)). 



(12) 



In this way, V{r) acts as a fractality measure while r 
corresponds to the representation scale. 

The function u can be used directly, as iiP^ or after 
some kind of transform. In this work, we propose a mul- 
tiscale transform to enhance the results obtained with 
fractal descriptors. 



IV. PROPOSED METHOD 



transform over that point. Here, we select the value of a 
empirically. 

Finally, we applied a threshold over the obtained signal 
in order to eliminate noises added by the application of 
the multiscale over the final part of Bouligand-Minkowski 
curve, where the data becomes more sensible due to the 
high level of wavefront interference. The threshold point 
is also determined empirically. 

The Figure [2] shows a summary of the steps in the 
proposed method in a box diagram. 




In image analysis, and particularly texture analysis, 
we are often faced with situations where the behavior 
of some analysis method varies severely according to the 
scale at which the image is analyzed. Multiscale trans- 
form was developed with the aim of attenuating such 
difficulty, providing robust information about features of 
the object which are observed only at specific scales. 

The multiscale transform, applied over a curve u{t) like 
that of fractal descriptors, consists in a mapping function 
of u{t) onto U{b^a)^ where b is directly related to t and 
a is the scale parameter. 

Basically, the literature shows three categories of mul- 
tiscale transform, to know, space-scale, time-frequency 
and time-scale^^. Here, we adopted the space-scale ap- 
proach, given its large use in image analysis and partic- 
ularly interesting results in works related to the identifi- 
cation of patterns in natural objects, like those studied 
in this wor#Eni. 

In this approach, the function U{b^a) is obtained by 
derivating the function u{t) and applying a Gaussian 
smoothing filter ga^ where a is the smoothing parame- 
ter. More formally, we have: 



U{b,a) = UHt)*ga{t) = UHt,a), 



(13) 



where U^{t^a) is the convolution of the original signal 
u{t) with the first derivative of the gaussian ^^, that is: 



U\t,a)=u{t)*gl{t). 



(14) 



Inasmuch as multiscale is a two-dimensional transform 
applied over a one-dimensional signal, it adds a subtan- 
tial amount of redundance information. To solve this 
drawback, we employed a technique based on the ad- 
justment of visual system to select objects in a scene^. 
Such solution, named fine-tuning selection consists in se- 
lecting a specific value of parameter a and projecting the 



FIG. 2. A diagram illustrating the essential steps involved in 
the proposed method. 

The Figure [3] depicts the discrimination power of the 
proposed descriptors, distinguishing visually among sam- 
ples from two classes. 
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FIG. 3. Discrimination ability of proposed descriptors D{k). 



V. EXPERIMENTS 

The efficiency of the proposed method is verified by 
a comparison with other classical and state-of-the-art 
methods in the classification of a texture data set. 

Here, we used the well-known Brodatz^^ texture data. 
This corresponds to 1110 images, each one divided into 
10 windows. Each image is a class and each window is a 
sample. 

The classification itself is carried out by the Linear 
Discriminant Analysis (LDA) classifiei^^ using a Hold- 



Out scheme, with one half of the data to train and the 
other half to validate. 

We compare the success rate to the use of Bouligand- 
Minkowski descriptors (without multiscale}^, Gabor 
wavelets descriptors^^, Co-occurrence matri:?Pand a mul- 
tiscale approach described iiP^. 



VI. RESULTS 

The Table [l] shows the success rate of the compared 
descriptors in the classification task of Brodatz data. We 
also show the number of descriptors used to provide the 
best result and the hz index^^, a measure of the reliability 
of the result. The value of 1 — a^: may also be used as an er- 
ror measure of the experiment. For the propoed method, 
we employed a parameter a = 0.7 and a threshold after 
the 51^^ element. 

We observe that the proposed technique provided the 
best results with a reasonable number of descriptors. 
Such aspect is interesting once beyond the computational 
efficiency, the obtainment of a high success rate using less 
descriptors turns possible the attenuation of dimensional- 
ity curse effects and produce a more reliable result. Also 
it is important to emphasize the high Hi value obtained 
by the multiscale approach, implying in a robust classi- 
fication process. 

Complementing the results in the previous table, we 
show the confusion matrices for each method in the Fig- 
ure |4j In this figure, we have a surface where the height 
at each point corresponds to the number of samples clas- 
sified as being from a predicted class (obtained) while 
pertains to an actual class (waited). In this graphical, 
we must observe the diagonal (corresponding to the sam- 
ples classified correctly) and peaks outside the diagonal, 
corresponding to the misclassifications. We see that such 
matrices reinforce the Table [B The best results corre- 
spond to matrices with less "holes" inside the diagonal 
and less peaks outside. For instance, the Mikowski and 
the proposed method have a similar matrix, except for 
the fact that Minkowski shows 3 little peaks outside the 
diagonal, while the proposed technique presents only one. 

In summary, we observe that the combination of fractal 
descriptors and space-scale transform constituted a pow- 
erful and robust method to provide texture descriptors. 
Although fractal descriptors provide a good result, as at- 
tested by the success rate of Minkowski method, it is still 
limitted to an analysis more global of the image, which 
limits its efficiency in more complex situations as, for in- 
stance, when we have a high degree of similarity from 
different classes and/or a high dissimilarity intra-class. 
The global fractal descriptors approach also has some di- 
ficulties in dealing with noised images. The multiscale 
approach allows the highlighting of scale-dependent nu- 
ances, characterizing the image in a richer way, unveiling 
important structures which only appear at some specific 
scale as well as isolating artifacts and noises inherent to 
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FIG. 4. Confusion matrices. (a) Multifractal. (b) Co- 
occurrence, (c) Gabor. d) Minkowski, e) Proposed method. 



the original image. 



VII. CONCLUSION 

This work proposed the application of a multiscale 
transform to the fractal descriptors method for the clas- 
sification of texture images. We applied the space-scale 
transform (derivative followed by Gaussian filtering) to 
the Bouligand-Minkowski fractal descriptors. After that, 
we also applied a threshold to the filter response to elim- 
inate the less significant information. 

We compared the method to other well-known texture 
descriptors and the results showed that the multiscale 
combination porvided the best success rate even with a 
reduced number of descriptors. Such performance con- 
ffimed the efficiency of multiscale transform associated 
to fractal geometry, once it allows the study of details 
which only can be detected at specific scales, turning, in 
this way, the analysis more complete and robust. 

The results also suggest the application of the proposed 
approach to other problems from the real world, involving 



Method 


Correctness Rate 


(%) 


K, 


Number of descriptors 


Co-occurrence 


92.0721 




0.9201 


84 


Gab or 


90.0901 




0.9001 


20 


Multifractal 


37.4775 




0.3732 


101 


Minkowski 


98.9189 




0.9891 


85 


Proposed 


99.4595 




0.9945 


51 



TABLE I. Correctness rate for the Brodatz dataset. 



the discrimination of objects in complex scenarios. 
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